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Summary 


Maintaining  a  corps  of  highly  skilled  Marines  is  critical  to  the  success 
of  the  Marine  Corps.  Perhaps  more  than  any  other  Service,  the 
Marine  Corps  is  considered  the  force  in  readiness,  prej^ared  to 
respond  to  any  contingency  at  a  moment’s  notice.  But  building  good 
Marines  takes  time.  Such  a  force  is  the  result  of  well-conceived  and 
properly  designed  training  and  education  programs.  The  Outer  for 
Naval  Analyses’  (C.NA)  training  analyses  are  designed  to  help  the 
Marine  Corps  develop  and  maintain  such  programs.  As  this  report 
shows,  these  analyses  have  tended  to  fall  into  two  distinct  categories — 
training  assessment/development,  and  the  economics  of  training 
(i.e.,  the  links  between  training  and  manpower). 

In  our  training  assessment/development  studies,  we  usually  attempt 
to  answer  one  or  both  of  the  following  questions,  “Is  what  is  being 
taught,  being  learned?”  and  “Is  what  is  being  taught,  what  needs  to  be 
tatight?”  Only  when  the  answer  to  both  of  these  is  “yes,”  is  the  training 
most  effective.  To  make  this  determination,  we  use  a  skills-based 
approach  to  identify  the  core  skills  (or  in  some  cases,  just  the  core 
tasks)  that  a  Marine  needs  to  acquire  through  specific  training  and  to 
assess  whether  the  training  teaches  those  skills,  or  we  may  analyze 
whether  the  skills  being  trained  are  the  skills  that  a  Marine  needs  to 
have  for  a  particular  type  of  operation  or  mission. 

As  an  example,  o\'er  the  past  20  years,  we  have  applied  a  skills-based 
approach  to: 

•  Assess  current  or  proposed  training  programs  based  on  critical 
mission  skill  development 

•  Develop  training  parameters/requirements  (based  on  critical 
mission  skill  development)  for  new,  or  non-standard  missions 

•  Determine  how  outside  factors,  such  as  encroachment  and 
resource  constraints,  affect  the  Marine  Corps’  ability  to  train 
critical  mission  skills 
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The  second  general  type  of  training  study  we  undertake  explores  the 
links  between  manpower  and  the  training  pipeline,  and  has  two  sub¬ 
sets.  The  first  sub-set  of  studies  from  this  category  focu  ses  on  the  rates 
and  causes  of  attrition,  particularly  for  first-term,  non-End  of  Active 
Service  (non-EAS)  Marines,  and  on  critical  indicators  that  the  Marine 
Corps  can  use  to  better  track  manpower  throughout  the  training 
pipeline.  The  second  sub-set  of  studies  in  this  categoiy  focuses  on 
how  long  it  takes  to  train  a  Marine,  and  the  effect  of  die  training  pro¬ 
cess  on  manpower. 

CNA’s  attrition-based  studies  found  that  overall  attrition  rates  had  not 
changed  dramatically  (either  for  better  or  worse)  between  1980  and 
1992,  despite  the  fact  that  recruit  quality  improved  considerably  over 
this  timeframe.^  In  addition,  we  found  that  certain  recniit  character¬ 
istics  (mainly  lower  educational  credentials  and  requiring  waivers) 
were  linked  to  an  increased  likelihood  of  attriting  early.  We  also 
found  that  many  attritions  were  for  physical  reasons  and  proposed 
several  ways  to  modify  recruit  training  so  as  to  decrease*  the  chance  of 
physical  injuries  (in  turn  hopefully,  lowering  attrition). 

CNA’s  time-to-train  studies  focused  on  developing  a  tool  to  help  the 
Marine  Corps  determine  how  long  it  really  takes  to  train  new  Marines. 
Through  this  series  of  studies,  we  determined  realistic  times-totrain 
for  each  Primai'y  Military  Occupational  Specialty  (PMOS).  We  fur¬ 
ther  analyzed  the  total  training  time  to  determine  its  components 
and  created  a  database  that  enables  the  Manne  Corps  to  see: 

•  How  much  time  is  spent  in  the  classroom 

•  How  much  time  is  spent  waiting  for  courses  to  convene 

•  How  much  time  is  added  due  to  setbacks. 

While  our  analyses  show  that  Marines  spend  a  large  amount  of  time 
awaiting  training,  we  caution  the  reader  not  to  Jump  to  the  conclu¬ 
sion  that  there  are  inefficiencies  in  the  training  pipel  ne.  Given  the 
current  operating  environment,  manpower  constraints,  and 


1.  We  caution  that  these  studies  are  over  10  years  old  and  some  of  their 
findings  may  no  longer  hold. 


distribution  of  Marines  entering  the  pipeline,  the  current  system  may 
be  operating  as  efficiently  as  possible.  Rather,  our  database  and  rec¬ 
ommendations  are  designed  to  give  the  Marine  Corps  the  means  to 
make  this  determination. 

In  summaiy,  while  the  specific  findings  from  any  indi\idual  study  are 
important  in  that  the  analyses  hopefully  answer  the  sponsor’s  partic¬ 
ular  question  at  hand,  they  may  be  even  more  significant  when  con¬ 
sidered  as  part  of  the  entirety  of  our  training  analyses.  As  this  report 
shows,  considered  together,  the  approaches,  methodologies,  and 
data  we  use  for  these  studies  give  the  Marine  C^orps  the  tools  it  needs 
to  better  assess  its  training  programs,  processes,  and  pipeline,  and  to 
better  prepare  itself  for  the  future. 
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Introduction 


The  Onter  for  Naval  Analyses  (CNA)  has  executed  luiineroiis  studies 
for  the  Marine  Corps.  These  have  included  both  formal  studies  by 
analysts  at  CNA  headquarters  and  less-formal  analyses  conducted  by 
CNA  field  representatives  in  support  of  their  commands.  Over  the 
years,  many  of  these  analyses  have  focused  on  five  critical  areas:  oper¬ 
ational  assessment,  organizational  analysis,  reconstruction  of  real- 
world  operations,  prepositioning,  and  training.  f\)r  several  reasons — 
including  the  nature  of  the  field  representative  program,  the  require¬ 
ments  of  various  commands,  and  the  disconnect  between  field  woi  k 
and  headquarters-based  analyses — most  of  our  efforts  in  these  areas 
have  been  discrete  and  little  effort  has  been  made  to  synthesize  their 
results.  In  short,  there  is  no  overarching  document  that  synthesizes 
the  method  and  substance  of  the  work  we  have  done  in  each  of  these 
five  areas. 


Methodology 


In  this  CNA-initiated  study,  we  identify  key  themes  and  issues  in  each 
of  the  five  areas  of  analysis.  Our  overall  approach  was  to  take  a  critical 
look  at  the  work  (especially  the  more  recent  analyses)  we  have  done 
for  the  Marine  ("orps  in  each  of  the  identified  key  areas.  Figure  1  sum¬ 
marizes  the  four-step  process  we  used  to  execute  our  analysis  plan. 
For  each  of  these  areas,  we  present  the  “bottom  line”  results  of  our 
efforts.  We  have  designed  the  study  to  provide  for  separate  documen¬ 
tation  for  each  key  area.  Our  previous  reports,  Operational  Assessment 
Primer:  A  Synthesis  of  CNA's  Work  for  the  Marine  Corps,  Organizational 
Analysis  Primer:  A  Synthesis  of  CKA's  Work,  Real-World  Opeiations:  A  Syn¬ 
thesis  of  Issues  Challenging  the  Marine  Corps,  and  Prepositioning:  A  Synthe¬ 
sis  of  CNA\s  Work  for  the  Marine  Corps,  were  published  in  October  2006, 
August  2007,  January  2008,  and  May  2008,  respectively  [1-4].  This  is 
the  final  task  and  deliverable  for  this  study,  and  marks  the  completion 
of  this  phase  of  our  synthesis  efforts. 
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Figure  1 .  Four-step  process 


Tasking 


This  report  discusses  our  work  in  the  area  of  Marine  CA)rps  training. 
Though  some  may  argue  over  the  distinction  between  “training”  and 
“education,”  for  our  purposes  in  this  report,  there  is  little  difference.^ 
While  each  individual  study  may  emphasize  one  over  the  other  (e.g., 
training  over  education,  or  vice  versa),  our  analyses  isually  encom- 
pass  a  combination  of  the  two.  Therefore,  while  we  use  the  term 
“training”  throughout  this  report,  the  term  is  meant  to  encompass 
both  ways  (i.e.,  training  and  education)  that  Marines  become  highly 
skilled  and  highly  knowledgeable. 


2.  In  general,  training  emphasizes  the  performance  of  slcills  and  proce¬ 
dures  (i.e.,  the  proper  utilization  of  an  Mk-19),  while  education  empha¬ 
sizes  the  method  and  decision-making  framework  that  would  be  applied 
to  a  scenario  [5]. 


6 


Over  the  hist  20  years,  CNA  has  executed  numerous  studies  on  a  wide 

Q 

range  of  training-related  issues/  A  careful  review  of  these  analyses 
shows  that  our  studies  generally  fall  into  one  of  two  distinct  categories 
or  types — training  assessment  and  development,  or  the  economics  of 
training.  The  first  seiies  of  studies,  those  we  categorize  as  “training 
assessment,”  focus  on  analyzing  whether  a  specific  type  of  training  or 
training  event  meets  the  Marine  Corps’  specified  or  implied  goals. 
The  second  series  of  studies,  those  we  categorize  as  the  economics  of 
training,  focus  on  the  link  between  training  and  manpower.  The  two 
types  of  studies  are  veiy  different  from  one  another,  and  each  applies 
a  unique  approach  to  the  analyses  it  encompasses.  Our  goal  in  this 
report  is  to  synthesize  the  key  aspects  of  each  series  of  studies,  show¬ 
ing  our  intended  audience  (i.e.,  CNA  analysts.  Marine  Corps,  and 
other  potential  sponsors)  how  we  approach  the  different  tyj^es  of 
studies  and  their  main  lessons  or  takeaways. 


Organization 


We  organize  this  report  into  two  main  sections,  each  focusing  around 
one  of  the  two  series  of  studies  discussed  above.  In  the  first  section, 
we  discuss  our  training  assessment,  evaluation,  and  development 
studies.  We  describe  the  primai'y  method  that  we  use  to  conduct  such 
analyses — the  skills-based  approach.  We  show  how  we  use  this 
approach  to  analyze  whether  existing  (or  proposed)  training  is  meet¬ 
ing  the  Marine  (Corps’  objectives  and  a  trainee’s  needs.  In  the  second 
section,  we  discuss  the  series  of  studies  that  focus  on  the  economics 
of  training  and  retaining  Marines.  The  studies  we  examine  for  this 
section  include  our  analyses  of: 

•  The  relationship  between  training  and  non-End  of  Active  Ser¬ 
vice  (non-EAS)  attrition 


3.  While  many  of  (^NA's  training  studies  have  been  executed  solelv  on 
behalf  of  the  Marine  C>orps,  some  studies  ha\’e  been  done  for  non- 
USMC  sponsors.  To  the  extent  that  such  studies  informed  our  Marine 
Corps  analyses,  we  include  their  “results’’  in  this  report. 
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•  Manpower  critical  indicators 

•  “Time-to-train”  and  its  impact  on  manpower. 

We  conclude  with  our  final  thoughts  on  the  overall  body  of  our  anal¬ 
yses  in  the  area  of  Marine  Corps  training. 


Training  assessment 


In  this  section,  we  discuss  CNA’s  first  general  type  of  training  study — 
training  assessment  and  development.  We  have  executed  numerous 
studies  that  fall  into  this  categoiy  Specific  studies  have  focused  on: 

•  Aircrew  and  pilot  training  [6-22] 

•  Weapons  tactics  training  [23] 

•  (Combined  Arms  Exercise  training  [24-27] 

•  Better  methodologies  for  training  inanageineiit  (specifically 
focused  on  ground  combat  training  plans)  [28-33] 

•  Marine  Expeditionaiy  Brigade  (MEB)  training  [34-37] 

•  Impacts  of  encroachment  on  training  [38-40] 

•  Irregular  \varfare  training  [5,  41-^14]. 

As  this  list  shows,  this  categoiy  of  training  study  covers  a  wide  array  of 
specific  topics.  Less  evident  is  that  these  studies  also  varied  on  the  spe¬ 
cific  training  issue  or  question  addressed.  In  some  of  these  studies  we 
evaluated  existing  training  (or  training  process)  to  determine  if  it  was 
meeting  documented  objectives/requirements  and  identify  how  it 
might  be  refined  to  better  do  so  [(>-16,  23-33].  In  other  studies,  we 
were  tasked  to  develop  training  or  training  requirements  based  on  a 
review  of  operational  requirements  [5,  34-37,  41-44].  In  other  studies 
still,  we  assessed  the  impact  of  outside  influences  (e.g.,  range  avail¬ 
ability,  funding,  and  equipment  resources)  on  training  opportunities, 
readiness,  or  performance  [17-22,  38-40].  Regardless  of  the  specific 
training  issue  or  question  being  addressed  by  a  particular  study,  how¬ 
ever,  our  basic  overall  approach  was  to  look  at  training  effectiveness 
or  impacts  from  the  most  detailed  level  possible  (e.g.,  required  skills, 
tasks,  or  capabilities)  given  the  constraints  of  the  study  (e.g.,  time, 
availability  of  data).  In  this  section,  we  discuss  our  approach,  which 
we  call  the  skills-based  approach,  and  its  applications. 
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Skills-based  approach 

Building  good  Marines  doesn’t  happen  overnight.  Our  training  stud¬ 
ies  are  designed  to  help  the  Marine  Coi'ps  assess,  refine,  and  develop 
training  programs  and  processes  that  produce  well-trained,  highly- 
skilled  Marines.  At  their  core,  our  analyses  are  designed  to  answer  the 
questions  “Is  what  is  being  taught,  being  learned?”  and  “Is  what  is 
being  taught,  what  needs  to  be  taught?”  Only  when  the  answer  to 
both  of  these  is  “yes,”  is  the  training  most  effective.  Therefore,  in 
these  types  of  studies,  we  may  identify  the  core  skills  thi^  Marine  needs 
to  acquire  through  that  training  and  assess  whether  the  training 
teaches  those  skills,  or  we  may  analyze  whether  the  skills  the  training 
is  theoretically  designed  to  teach  are  the  skills  the  Marine  needs  to 
have  for  a  particular  type  of  operation  or  mission.  We  generally  make 
such  assessments  using  the  skills-based  approach.  Whi  e  the  details  of 
how  we  apply  the  approach  may  vary  slightly  from  one  study  to 
another,  the  overall  methodology  remains  fairly  constant. 

Background 

Maintaining  a  body  of  highly  skilled  Marines  is  critical  to  the  success 
of  the  Marine  Corps.  Perhaps  more  than  any  othcu'  Service,  the 
Marine  Corps  is  considered  the  force  in  readiness,  prepared  to 
respond  to  any  contingency  at  a  moment’s  notice.  This  type  of  force 
can  only  be  the  result  of  a  well-conceived  training  and  education  pro¬ 
gram,  which  is  characteristic  of  the  Marine  Corps. 

The  Marine  Corps  believes  that  successful  Marine  units  train  as  they 
fight  and  fight  as  they  train.  This  ethos  is  the  foundation  of  unit  train¬ 
ing  in  the  Marine  Corps.  Three  key  elements  form  the  backbone  of 
this  ethos: 

•  Unit  Training  Management  (UTM) 

•  Systems  Approach  to  Training  (SAT) 

•  Training  &  Readiness  (T&R)  standards 

UTM  uses  the  Marine  Corps  Training  Principles  and  the  SAT  to  max¬ 
imize  training  results  and  focus  on  the  training  priorities  in  prepara¬ 
tion  of  wartime  missions.^  The  SAT  process  gives  commanders  a 
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model  to  use  when  planning  and  conducting  training,  and  helps 
ensure  that  Marines  acquire  the  knowledge  and  skills  essential  to  be 
successful.  Training  &  Readiness  (T&R)  standards,  outlined  in  T&:R 
manuals  and  matrices,  are  used  to  evaluate  a  Marine’s  or  a  unit’s  pro¬ 
ficiency  in  the  tasks  required  for  a  specific  militaiT  occupational  spe¬ 
cialty  (MOS)  or  a  unit’s  ability  to  perform  a  specific  combat  mission. 


Focus 


Marines  of  all  specialties  undergo  a  process  of  continuous  tactical 
training  throughout  their  careers  in  order  to  develop  and  maintain  a 
state  of  operational  readiness  for  whatever  their  particular  missions 
or  roles.  One  way  to  measure  readiness  or  how  proficient  a  Marine  or 
Marine  unit  is  at  a  given  point  in  time  is  to  track  the  completion  of 
specific  training  events  or  the  results  of  completed  missions.  While 
these  methods  have  been  used,  all  indications  were  that  they  were  not 
veiy  effective  [8,  14]. 

The  skills-based  approach  uses  the  achievement  of  skills  (not  the 
completion  of  events)  as  the  basis  for  determining  the  state  of  readi¬ 
ness,  and  thus,  the  effectiveness  of  a  particular  training  event  or  pro¬ 
gram.  Figure  2  represents  these  connections.  The  dashed  line 
connecting  Training  Event  X  to  Readiness  State  Y  indicates  there  is 
only  a  secondaiy  relationship  between  the  two.  It  exists  only  to  the 
extent  that  the  training  event  led  to  the  achievement  of  Skills  A,  B, 
and  C,  which  in  turn  led  to  the  achievement  of  Readiness  State  Y.  Our 
approach  views  proficiency  or  readiness  not  in  terms  of  events  com¬ 
pleted,  but  rather  in  terms  of  the  ability  to  execute  critical  mission 
skills. 

IJTM  describes  the  process  of  selecting  tasks  from  the  T&R  standards 
and  designing  training  plans  to  practice  them.  Our  skills-based 
analyses  have  been  integral  to  developing  and  maintaining  the  rigor 


4.  The  Marine  Corps  Training  Principles  arc:  Train  as  You  Fight,  Make 
Commanders  Responsible  for  Training,  Use  Standards-Based  Training, 
Use  Performance-Oriented  Training,  Use  Mission-Oriented  Training, 
Train  the  Marine  Air-Croiind  Task  Force  (MAGTF)  as  a  Combined- 
Arms  Team,  Train  to  Sustain  Proficiency,  and  Train  to  Challenge. 


Figure  2.  Schematic  of  the  skills-based  approach 


of  this  training  ethos  by  helping  to  determine  which  t^sks  and  skills 
are  critical  to  mission  success,  and  helping  to  demonsirate  the  con¬ 
nection  between  the  level  of  practice  of  the  task  and  the  proficiency 
in  performing  it.  In  addition,  if  tasks  are  not  well  articulated,  we  assist 
in  identifying  what  to  focus  on  in  training.  Or,  when  a  new  mission 
arises,  we  help  determine  whether  current  training  meets  new 
requirements.  By  dissecting  the  new  mission  into  its  taj^ks  and  skills, 
we  can  determine  which  are  already  being  covered  by  training  events 
and  which  are  falling  through  the  cracks.  When  commanders  know 
what  training  is  lacking,  they  can  more  precisely  design  pre-deploy¬ 
ment  work-ups. 

We  point  to  four  unique  aspects  of  the  skills-based  app  roach.  First, 
using  skills  as  the  basis  to  evaluate  training  and  readiness  allows  one 
to  clearly  understand  the  connection  between  practice  and  perfor¬ 
mance.  Second,  the  skills-based  approach  works  backwards  in  that  it 
starts  with  mission  requirements  and  works  “back”  to  identify  the 
training  needed  to  support  those  mission  requirements.  Third,  this 
analytic  approach  allows  one  to  consider  (and  stress)  the  importance 
of  intellectual  skills  (e.g.,  decision-making  and  recognition)  and  the 
connections  between  these  skills  within  the  context  of  i:he  mission. 
And,  fourth,  the  skills-based  approach  is  practical  and 
reproducible — it  is  a  methodology  that  commands  can  use  when 
designing  or  evaluating  other  training. 
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These  characteristics  of  the  skills-based  approach  have  helped  to 
refine  training  in  the  Marine  Corps.  Some  of  the  other  approaches 
that  were  used  in  the  past  were  unable  to  link  training  resources  to 
readiness,  which  sometimes  resulted  in  tasks  being  added  into  train¬ 
ing  programs  without  much  consideration  as  to  how  they  fit  into  a 
mission’s  requirements  or  a  trainee’s  needs.  In  addition,  more  classic 
training  design  methodologies  focus  only  on  thcxse  things  that  are 
measurable  or  quantifiable.  The  skills-based  approach  has  shown  that 
incorporating  intellectual  skills  into  training  can  lead  to  better  train¬ 
ing  objectives  and  performance  measures. 

Finally,  it  is  important  to  note  that,  in  many  instances,  a  comprehen¬ 
sive  list  of  required  skills  for  a  Marine  (or  set  of  Marines)  is  not  always 
readily  available.  Therefore,  in  many  of  our  analyses,  we  start  by  com¬ 
piling  the  required  missions  required  for  that  unit  and/or  trained 
from  a  specific  training  event  or  program.  Since  (operational  missions 
are  really  Just  a  set  of  functions  that  require  the  execution  of  actions 
(i.e.,  tasks)  in  a  sequential  manner,  we  break  the  missions  d(0wn  into 
their  component  tasks.  We  break  tasks  down  into  smaller  pieces  (i.e., 
sulMasks),  and,  to  the  extent  possible,  we  break  tasks  down  into  their 
iiKotor  and  intellectual  skills."^’  This  building  block  effect  is  repre¬ 
sented  in  figure  3. 

Methodology  for  assessment 

The  skills-based  approach  to  training  assessment  or  development  has 
tw(o  main  steps,  each  with  siib-steps: 

•  Identify  critical  skills  for  mission  execution 
—  Develop  task  list 
—  Apply  lisk  assessment  methodology’ 

-  Make  chronological  linkages 


5.  While  we  call  this  the  skills-based  approach,  in  some  instances  we  are 
not  able  to  analyze  down  to  this  lc\’el  of  granularity.  In  those  instances, 
we  use  an  abbreviated  skills-based  methodology,  which  uses  tasks  or 
capabilities  as  the  basis  for  assessing,  erahiating,  or  developing  training 
events  and  programs. 
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Figure  3.  Building  block  approach  to  skills-based  methodology 


-  Make  functional  linkages 

•  Develop  measures  of  performance 

—  Break  out  mission  processes  by  mission  segment 

—  Identify  functional  outputs  and  observables 

As  indicated  above,  the  starting  point  for  our  skills-based  approach  is 
the  conduct  of  a  task  analysis.  Such  an  analysis  identifies  all  the  tasks 
that  comprise  a  function,  as  well  as  their  components  (sub-tasks).^ 
This  may  result  in  an  extremely  detailed  and  long  list  of  skills,  which 
is  too  unwieldy  to  be  of  practical  use  to  trainers.  Our  next  step  is  to 
link  the  skills  chronologically  (in  terms  of  mission  flow  and  transi¬ 
tions)  and  functionally  (in  terms  of  mission  processes)  so  that  we  can 
identify  which  skills  are  critical  and  determine  relational  perfor¬ 
mance  measures. 


6.  For  our  analyses,  we  use  a  wide  range  of  sources  to  determine  mission 
task  lists.  These  include  doctrine,  lessons  learned,  training  manuals, 
training  syllabi,  memos,  guides,  interviews,  subject  matter  experts,  tacti¬ 
cal  manuals.  Journals,  operational  plans  (OPIANs),  Universal  Joint 
Task  lists  (UJTLs),  service  task  lists,  higher  headquarter  guidance,  sur¬ 
veys,  previous  studies,  observations,  and  training  standards. 
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Critical  skills 


Because  the  initial  list  of  required  skills  from  step  1  is  usually  quite 
detailed  and  long,  a  sub-step  in  the  process  is  usually  an  effort  to  pare 
down  the  skills  list  to  determine  the  critical  skills.  These  skills  are 
those  that  are  highly  significant  to  mission  success.  They  must  be 
mapped  into  training  objectives,  which  are  the  focal  points  of  train¬ 
ing  events.  While  a  trainee  needs  to  be  able  to  perform  (and  so,  must 
practice)  all  of  the  tasks  and  skills  identified,  the  non-critical  skills  do 
not  necessarily  need  to  be  the  focus  on  a  specific  training  event.  For 
example,  assume  target  acquisition  is  a  critical  skill.  During  a  training 
event  that  focuses  on  narigating  into  a  target  area  and  designating  an 
intended  target,  a  trainee  will  still  pmctice  taking  off  and  landing,  but 
those  skills  are  not  the  objectives  of  the  specific  training  event. 

We  use  a  risk  assessment  method  to  determine  critical  skills.  We  con¬ 
sider  three  factors: 

•  Chronological  links  Wwh  other  skills 

•  Significance  and  the  effect  that  inadequate  skill  performance 
would  have  on  fundamental  attention  areas 

•  Functional  links  \\\ih  other  skills  as  viewed  from  the  proce.ss  per¬ 
spective. 

We  make  chronological  linkages  using  execution  timelines  in  order 
to  risualize  the  inter-relationships  between  skills.  In  some  cases,  there 
are  parallel  timelines  that  must  be  considered.  For  example,  in  our 
analyses  of  aircrew  skills,  we  use  four  broad  categories  to  characterize 
process  timelines — mobilit\',  effectiveness,  surxivability',  and  coordina¬ 
tion  [7,  12].  We  use  these  categories  again  when  assessing  signifi¬ 
cance.  We  examine  each  skill  (or  in  some  instances,  each  task)  for  its 
importance.  In  our  aircrew  training  work,  we  used  a  three-level  rank¬ 
ing  structure — low,  moderate,  and  high.  Table  1  details  an  example 
of  the  results  of  our  asse.ssment  from  our  F/A-18  study. 

We  make  functional  linkages  using  a  mission  process-oriented 
approach.  Continuing  with  the  example  above,  foi  our  aircrew  train¬ 
ing  analyses,  we  used  a  five-step  aircrew  functioning  sequence  devel¬ 
oped  by  Roscoe — sense,  recollect,  recognize,  decide,  and  manipulate 
[7,45]. 
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Table  1 .  Examples  of  ranking  significance  of  aircrew  tasks^ 


Task 

Mobility 

Coordination 

Survivability 

Effectiveness 

Comments 

Perform  climb 
to  cruise 

Low 

Low 

Low 

Low 

Not  flying  optimal 
profiles  will 
increase  fuel  used 

Perform  aerial 
refueling 

High 

Moderate 

Low 

Low 

Not  refueling  will 
limit  mission 
radius,  affect  pack¬ 
age  composition 

Assess  no  go 
criteria 

Low 

High 

High 

Moderate 

Not  following  no 
go  ( riteria  will  put 
mission  at  risk  from 
reduced  force 
stru<:ture  or 
changed  conditions 

Perform  target 
acquisition 

Low 

Low 

Low 

High 

Not  acquiring  the 
target  precludes 
suc(  essful  weap¬ 
ons  employment 

Perform 
weapon  deliv¬ 
ery  maneuver 

Low 

Low 

Moderate 

Moderate 

Profile  used  to 
deliver  weapon  in 
accordance  with 
weaponeering 
solution  and  to 
avoid  threat  enve¬ 
lopes 

Maintain  com¬ 
munications 
with  controller 

a.  Source:  [6]. 

Low 

High 

Moderate 

High 

Information  flow 
needed  to  develop 
situctional  aware¬ 
ness  on  threat, 
deconflict,  and 
decide  to  employ 
weaaons 

Performance  measures 

We  previously  mentioned  that  research  has  shown  that  performance 
measures  based  on  overall  mission  results  or  event  completion  are 
generally  of  low  utility.  Our  approach  proposes  using  performance 
measures  as  indicators  of  successful  mission  process  execution.  Using 
the  critical  skills  we  identified  with  our  risk  assessment  methodology, 
we  develop  relational  performance  measures  for  each  mission  phase 
or  segment.  Using  process-based  measures  provides  a  framework  for 
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a  detailed  mission  analysis  and  enables  the  trainer  to  use  the  task  anal¬ 
ysis,  mission  timelines,  and  process  functional  analysis  to  probe 
deeper  into  performance  issues  [7].  Figure  4  conceptually  illustrates 
the  differences  among  the  two  traditional  approaches  and  our 
approach. 


Figure  4.  Approaches  to  developing  performance  measures^ 


a. 


Operational  mission - ^  ^ 


3 


Task  analysis 


Tasks  &  skills/ 
M  ission  segm ents 


M  ethod  using 
m  ission  rcsu Its 
as  measures 


rM  o  d  e  1 


Process 


Risk  assessment 
pA  ission  tim  elines 


Critical  skills 


^  M  ethod  using 
\  tasks  as 

\  m  casu  res 

\ 

I 

I 

I 

I 
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Performance  measures 


Identify  process  / 

indicators  ^ 
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a.  Revised  from  17). 


Again,  our  goal  is  to  develop  performance  measures  that  are  indica¬ 
tors  of  successful  execution  of  mission  processes.  Therefore,  we  iden¬ 
tified  the  observable  indicators  of  process  execution  during  each 
mission  segment.  VVe  do  this  by  establishing  the  functional  outputs 
and  observables  from  the  critical  skills  identified  for  each  process, 
and  synthesizing  them  into  performance  measures.  Table  2  lists  per¬ 
formance  measures  for  the  Search  and  Rescue  (SAR)  mission  process 
from  our  E-2C  study. 


17 


Table  2.  Critical  skills  and  performance  measures  for  E-2C  SAR  mission  (in  addition  to  core)^ 


Mission 


process 

Critical  skills 

Process  step 

Performance  measures 

On-Station 

Determine  location  of  mission 
aircraft 

Sense/Recog¬ 

nize 

Locate  missing  aircraft  using  radar 
and  voice  communications. 
Organize  and  manage  search  for 
downed  aircraft.  Es  ablish  and 
maintain  communications  with 
other  assets  to  coordinate  search. 

On-Station 

Develop  tactical  picture  of  the 
overall  situation  around  SAR 
effort 

Sense/Recog¬ 

nize 

Build  a  picture  of  the  situation 
from  recognized  air  and  surface 
contacts.  Enter  and  update  tracks 
in  a  timely  manner.  Maintain 
quality  of  overall  picture. 

On-Station 

Manage  and  control  assets 
available  for  SAR  mission 

Decide/Act 

Assume  tactical  cortrol  of  SAR 
assets.  Monitor  fuel  states  and 
tanking  available  to  support 
effort. 

On-Station 

Maintain  communications  flow 
for  SAR  effort 

Sense/Act 

Maintain  connectivity  required  to 
support  information  flow.  Use 
established  SAR  communications 
procedures  and  manage  traffic. 
Provide  prompt  situation  reports 
and  briefings. 

On-Station 

Provide  AEW  and  maritime  sur¬ 
veillance  against  threats 

Sense/Recog¬ 

nize 

Recognize  and  monitor  threat  air 
and  surface  contacts  in  the  area. 
Maintain  accurate  accounting  of 
friendly  assets  in  the  area. 

a.  Source:  ttit: 


As  the  table  shows,  the  end  result  of  the  skills-based  approach  is  a  list 
of  critical  skills  and  related  observable  performance  measures.  These 
tools  enable  a  trainer  to  consistently  evaluate  events  an<l  trainees  for 
their  ability  to  execute  what  a  specific  mission  requires.  Our  analyses 
show  that  this  methodology  has  even  broader  applications. 

Applications 


In  the  above  paragraphs,  we  discuss  our  skills-based  approach  to 
training  assessment.  We  describe  how  this  approach  connects  opera¬ 
tional  requirements  to  component  skills  and  skills  to  training  events. 
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But  why  make  such  connections?  Our  analyses  identified  several  key 
applications  of  using  this  method  in  assessing  and/or  developing 
training  programs  or  events.  These  include: 

•  Linking  performance  measures  to  readiness  in  order  to  deter¬ 
mine  the  effectiveness  of  training  [9,  15,  16,  23] 

•  Designing  improved  T8cR  matrices,  training  programs,  and 
assessment  systems  to  better  match  resources  to  operational 
training,  including  better  alignment  of  training  opportunities 
to  units  and  units  to  exercises  [8,  12,  23,  25,  33] 

•  Examining  the  use  of  alternative  media  (e.g.,  simulators)  for 
training  certain  events  or  skills  [8,  11] 

•  Facilitating  more  effective  coordinated  and  integrated  training 

•  Determining  the  training  events  (or  training  program)  and  the 
environment  required 

—  for  various  MAGTF  organizations  (e.g.,  the  MEB)  [37] 

—  based  on  range  and  resource  constraints  [40] 

•  Identifying  gaps  between  wbat  is  trained  and  what  is  operation¬ 
ally  required  [5,  37,  41 , 43,  44] 

•  Developing  tools  to  enable  commanders  to  understand  the 
incoming  skill-level  of  their  Marines  (of  various  rank)  in  light 
of  what  skills  they  might  expect  to  use  when  tactically  deployed 
[5,  42-44]. 

In  the  following  sub-sections,  we  discuss  these  applications  in  greater 
detail. 

Linking  performance  measures  to  readiness 

One  obvious  application  for  the  skills-based  approach  is  to  determine 
the  value  of  the  training  event.  One  way  to  do  this  is  to  determine  a 
training  event’s  impact  on  readiness.  This  requires  making  a  connec¬ 
tion  between  the  skills  and  performance  measures  identified  in  our 
skills-based  approach  to  operational  readiness  (or  potential  readi¬ 
ness)  ,  so  that  we  can  determine  what  training  is  effective  and  what  will 
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be  lost  if  certain  training  is  forfeited.  As  an  example,  ^ve  applied  the 
methodology  in  this  way  in  our  F/A-18  training  analysis  [9]. 

First,  we  express  each  step  of  a  training  process  in  terms  of  the  skill- 
level.  We  then  connect  each  step  in  a  training  process  cycle  with  its 
associated  skills.  For  example,  the  six  step  aircrew  training  cycle 
would  be  [8]: 

1.  Planning — Determine  aircrew  mission  skills,  and  critical  skills 
for  emphasis.  Assess  aircrew  skill  state  needed  to  conduct  oper¬ 
ations.  This  effort  establishes  a  goal  for  the  training  cycle — 
which  aircrew  skills  and  to  what  level  of  proficiency  the  skills 
need  to  be  performed. 

2.  Initial  Assessment — ^Assess  experience  level  and  skill  state  of 
entering  aircrews. 

3.  Select  training  events — Select  skills  needed,  assessing  qualifica¬ 
tion  and  currency  needs.  Map  skills  into  training  events. 

4.  Conduct  training — Exercise  skills  on  training  range  or  in  simula¬ 
tor.  Emphasize  critical  mission  skills. 

5.  Evaluation — ^Assess  level  of  skilled  performance  via  debriefing 
using  the  identified  performance  measures.  Propose  using 
three  levels:  needs  more  practice,  demonstrating  the  skill,  and 
consistently  demonstrating  the  skill. 

6.  Readiness  assessment — ^Assess  overall  aircrew  skill  and  knowledge 
state.  Return  to  step  3  to  build  and  maintain  skill  state.  Mission 
readiness  is  assessed  by  comparing  that  demonstrated  state  of 
learning  and  skilled  performance  to  the  established  baseline 
condition. 

We  can  then  develop  assessment  charts  for  operational  missions  using 
the  framework  developed  in  step  one  above.  Such  charts  are  based  on 
the  critical  skills  and  performance  measures  identified  using  our 
skills-based  approach.  Figure  5  presents  selected  results  of  how  we 
employed  this  technique  in  our  F/A-18  study.  This  anc.  other  charts 
like  it,  designed  for  different  events  in  the  same  training  program, 
could  be  used  by  trainers  in  assessing  the  level  of  skill  shown  by  the 
trainee  (or  trainees)  for  specific  events,  which  in  turn  can  be  trans¬ 
lated  into  how  “ready”  a  trainee  or  unit  is  for  a  real-world  operational 
mission. 


Figure  5.  Assessment  chart  for  Laser  Guided  Bomb  (LGB)  delivery  mission'^ 
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a.  Source:  |9l. 


Designing  improved  matrices,  programs,  and  assessments 

We  applied  (or  recommended)  this  application  in  several  studies, 
including  our  F/A-18  aircrew  study,  E-2C  aircrew  study.  Weapons  and 
Tactics  Instructor  (WTl)  study.  Marine  (>orps  Air-Ground  (a)mbat 
Center  (MCAGCC)  study,  and  our  Better  Methodologies  for  Training 
study  [8,  12,23,25,33]. 

We  have  given  several  examples  throughout  this  report  demonstrat¬ 
ing  how  our  analyses  in  the  F/A-18  and  E-2C  studies  provided 
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methods  and  tools  that  help  trainers  assess  and  refint  aircrew  train¬ 
ing.  Therefore,  we  will  only  briefly  present  how  some  of  our  other 
studies  applied  or  recommended  a  similar  application. 

In  the  WTI  study,  for  example,  we  focused  on  the  heliborne  assault 
evolution,  constructing  a  database  of  mission  tasks  and/or  skills  for 
that  evolution  using  lessons  learned  (rather  than  through  a  tradi¬ 
tional  task  analysis).  We  constiTicted  a  chronological  database,  high¬ 
lighting  19  mission  critical  tasks,  and  recommended  that  the  Marine 
Corps  consider  conducting  a  training  analysis  using  our  task  list  so 
that  trainers  could  determine  what  skills  are  developed  at  the  WTI 
course  and  which  skills  are  expected  as  prerequisite's.  This  would 
enable  them  to  refine  the  training  program  as  needed. 

Our  focus  in  the  Better  Methodologies  for  Training  Management 
study  was  to  develop  analytic  tools  to  help  planners  at  I  Marine 
Expeditionaiy  Force  (MEF)  and  within  the  MEF’s  battalions  to  better 
match  available  training  opportunities  to  unit  needs,  and  to  better 
match  available  units  to  exercise  requirements.  In  this  study,  we  used 
an  abbreriated  skills-based  approach  by  limiting  our  analyses  to  the 
task-level.  We  developed  templates,  down  to  the  company  level,  (e.g., 
rifle  companies,  weapons  companies,  and  headquart<*rs  and  service 
companies)  for  each  battalion  within  a  regiment,  identifying  mission 
tasks  down  to  the  platoon  level.  We  listed  the  mission  tasks  that  were 
recommended  objectives  of  the  training  conducted  by  the  unit  at  a 
specific  time  vertically,  and  indicated  whether  a  specific  mission  task 
was  recommended  to  be  covered  by  the  unit  over  the  <  ourse  of  train¬ 
ing  (and  how  often  the  task  was  addressed)  horizontally.  Next,  we 
applied  a  methodology  to  use  these  templates  to  help  the  Marine 
Corps  better  manage  training.  For  example,  figure  6  shows  how  the 
approach  matches  units  to  requirements.  If  emplcyed,  the  MEF 
should  be  able  to  better  manage  training  as  a  whole,  both  for  and 
within  the  MEF. 

To  facilitate  the  use  of  this  approach  (of  matching  units  to  require¬ 
ments)  in  [33],  we  developed  visualization  tools  foi  planners.  We 
merged  our  templates  with  a  Training  &  Exercise  Employment  Plan 
(TEEP)-like  view  of  the  combined  employment  of  all  of  a  division’s 
infantry  battalions  over  time,  creating  one  comprelnmsive  training 
picture.  The  goal  was  to  remove  “white  space”  from  the  training 


Figure  6.  Approach  for  matching  units  to  requirements^ 


a.  Source:  (33 1, 


schedule  and  replace  it  with  a  unit’s  training  intentions  and  activities, 
and  to  provide  a  single  display  that  showed  all  units  intentions  and 
activities  in  one  picture.  Wath  this  visualization  in  hand,  planners  can 
better  select  which  units  should  and  could  participate  in  MEF  or  divi¬ 
sion  training  requirements. 

Examining  the  use  of  alternative  media  (i.e.,  simulators) 

We  identified  this  application  in  our  aircrew  training  analyses  in  the 
late-1990s  [8,  14].  We  reconiniended  using  a  skills-based  approach  to 
considering  the  use  of  simulators  in  training  aircrews.  We  maintain 
that  developing  an  established  set  of  aircrew  mission  skills  would 
allow  trainers  to  begin  to  make  decisions  about  the  utility  of  different 
training  formats  and  media  (including  simulators)  for  various  audi¬ 
ences.  In  recent  years,  we  executed  several  studies  focusing  on  the  use 
of  sinuilators,  which  to  varying  degrees  have  relied  on  determining 
which  required  skills  can  be  trained  while  using  simulators  [18,  21, 
22]. 
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Facilitating  coordinated  and  integrated  training 

Our  analyses  indicate  that  the  skills-based  approach  can  be  used  to 
identify  ways  to  better  integrate  training  among  related  communities. 
We  highlighted  this  application  in  our  analysis  of  the  >i(^GCC 
Combined  Arms  Exercise  ((]AX)  training.  In  [24],  we  analyzed  indi¬ 
vidual  CAX  events,  identified  missions  and  skills  exe  xised  in  each 
event,  and  tried  to  understand  how  CAX  events  are  connected.  To  do 
this,  we  developed  a  mission  skill  template  for  each  (went.  We  also 
connected  specific  skills  with  specific  lessons  learned.  These  steps 
together  allowed  us  to  analyze  the  skills  and  examine  the  content  and 
structuring  of  the  training  program,  in  particular  tin?  connections 
between  training  events  in  the  building  bl(3ck  sequence,  and  to  ana¬ 
lyze  the  lessons  learned  in  order  to  analytically  identify  and  under¬ 
stand  the  training  issues  encountered  [26] .  Our  analysis  resulted  in  a 
series  of  modest  recommendations  to  better  prepare  the  force,  iden¬ 
tify  training  program  issues,  and  maintain  CAX  strengths.  One  of  our 
recommendations  in  the  area  of  addressing  issues  had  to  do  with 
force  integration.  We  noted  that  many  of  the  tactical  skills  exercised 
during  CAX  involve  the  coordination  and  integration  of  the  different 
communities  required  to  effectively  conduct  combir  ed  arms  mis¬ 
sions.  Effective  combined  arms  missions  involve  developing  an  under¬ 
standing  of  the  capabilities  and  limitations  of  other  communities,  so 
that  participants  can  better  anticipate  and  be  more  flexible  in  per¬ 
forming  the  mission.  We  highlighted  that  stove-piping,  particularly 
between  the  Ground  Combat  Element  (GCE)  and  th<?  Air  Combat 
Element  (ACE),  precluded  developing  effective  integration  and 
should  be  addressed  [25]. 

Determining  the  type  of  training  needed  and  the  ranges  needed  to 
conduct  it 

We  applied  our  skills-based  methodology  to  determint*  the  connec¬ 
tion  between  training  events  and/or  programs  with  the  required 
environment  in  two  cases.  In  [37],  we  (1)  identified  the  types  of  spe¬ 
cialized  training  required  for  a  MEB,  in  particular  its  Command 
Element  (CE),  (2)  characterized  the  training  environinent  required 
for  such  training,  and  (3)  analyzed  existing  training  areas  for  suitabil¬ 
ity.  The  basis  for  the  latter  two  steps  was  the  results  from  the  first  step. 


which  involved  using  a  capabilities-based  approach  (another  example 
of  an  abbreviated  or  modified  skills«based  approach)  to  determining 
what  a  MEB  must  be  prepared  to  do.  Our  initial  analysis  indicated 
that  most  of  the  war-fighting  and  indi\idual  skills  required  by  Marines 
operating  as  part  of  a  MEB,  were  already  being  taught  as  part  of  other 
training  programs,  and  that  “new”  training  was  really  only  needed  hy 
the  MEB  C^E.  Therefore,  we  focused  what  is  required  of  the  CE  in 
commanding  and  controlling  its  component  warfighting  elements 
(e.g.,  A(".E,  GCE,  and  logistic  support  element)  in  our  examination  of 
required  MEB  training.  We  then  considered  the  specifications  for  the 
full  spectrum  of  MEB  operations  (both  existing  training  and  the 
“new”  training  we  identified)  to  determine  the  required  environmen¬ 
tal  parameters  (e.g.,  range  size,  firing  limitations).  Finally,  we  ana« 
lyzed  existing  training  ranges  for  their  siiital)ility  to  conduct  a  variety 
of  MEB  missions,  from  the  smallest  company-level  mission  to  a  larger 
integrated  or  Joint  mission  [34-37].  Ultimately,  we  found  that  while 
existing  ranges  could  support  some  form  of  MEB  training,  each  had 
its  limitations,  which  we  identified  so  that  the  Marine  (k)rps  could  see 
what  is  sacrificed  at  each  [37]. 

Another  application  of  our  methodolog)'  is  to  use  our  skills-based 
analysis  results  to  identify  the  impacts  of  range  and  resource  con¬ 
straints.  Our  analysis  of  the  potential  of  simulators,  discussed  above, 
is  one  example  of  how  funding  and  resource  constraints  make  simu¬ 
lators  attractive  alternatives  to  live  tactical  training  (e.g.,  flying  hours, 
bomb  drops).  Another  example  involves  our  study  of  how  encroach¬ 
ment  issues  have  restricted  the  Na\y  and  Marine  C^orps  use  of  certain 
ranges  [40].  Figure  7  depicts  our  approach  determining  how  unit 
capabilities  or  skills  were  impacted  by  training  range  restrictions. 

In  [39],  we  applied  this  approach  to  operational  units  and  the  train¬ 
ing  infrastructure  at  C>amp  Lejeime,  N(].  We  recommend  that  tlie 
Marine  (x)rps  use  follow  this  same  approach  when  evaluating  other 
encroachment  or  resource  constraints. 

Identifying  gaps  between  training  and  operational  requirements 

In  our  analyses  of  counterinsurgency  (COIN)  and  irregular  warfare 
(IW)  training,  we  applied  a  skills-based  approach  to  identify  gaps 
between  existing  training  and  existing  “requirements”  [5,  41, 43,  44]. 
For  example,  in  [5],  we  mapped  lessons  learned  from  Operation 


Figure  7.  Approach  to  linking  encroachment  and  unit  capabilities/skills^ 
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a.  Source:  (40). 


Iraqi  Freedom  (OIF),  training  guidance  from  the  lnfanti7T&R  Man¬ 
ual,  and  the  Basic  Urban  Skills  Training  (BUST)  Package  to  a  set  of 
25  counterinsurgency-specific  tasks  that  we  defined  based  on  back¬ 
ground  research.  We  compared  the  emphasis  placed  on  a  specific 
task  in  training  (per  the  training  guidance)  to  the  relative  emphasis 
placed  on  it  in  actual  events  (i.e.,  the  requirement  for  the  task)  by 
unit  level.  The  disparity  between  the  two  was  identific  d  as  the  “gap” 
in  training.  We  then  grouped  gaps  by  category  to  highlight  those 
types  of  tasks  that  have  the  largest  and  smallest  gaps.  Figure  8  depicts 
our  results  for  one  level  of  our  gap  analysis.  The  results  depicted 
below  and  more  detailed  mappings  (not  shown)  highlight  key  gaps 
between  operations  and  training.  These  include  the  complete  lack  of 
training  for  infantry  Marines  in  information  operations,  coordinated 
host  nation  operations,  intelligence  dissemination  and  management, 
and  handling  captures,  despite  the  fact  that  COIN  and  IW  operations 
require  such  skills.  As  this  example  shows,  an  abbreviai  ed  skills-based 
approach  can  be  applied  as  part  of  a  gap  analysis  to  show  the  short¬ 
falls  in  current  training,  which  could  help  commanders  use  unit  train¬ 
ing  time  to  close  the  gaps  he  believes  are  most  critical. 
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Relative  Emphasis 


Figure  8.  Categorical  emphasis  of  current  operations  vice  T&R  training‘^ 
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a.  Source:  |5]. 


Developing  tools  for  commanders  to  assess  the  skill-level  of  their 
Marines 


We  took  the  gap  analysis  conducted  in  [5]  and  [42]  a  step  further  by 
developing  a  tool  that  commanders  could  use  to  assess  the  training  of 
their  Marines  (by  rank  and  MOS)  for  IW  requirements.  By  mapping 
the  IW  unit  task  list  to  the  MOS  Training  Sc  Education  (T&E)  contin¬ 
uum,  we  developed  matrices,  by  MOS,  to  depict  the  training  (i.e., 
exposure  level)  of  Marines  of  various  rank  to  each  IW  task.  Table  S  is 
an  example  of  such  a  matnx. 
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Table  3.  Exposure  of  031 1  s  to  IW  unit  tasks  through  individual  T&E  curriculum^  ^ 


Pvt-LCp  CpI 


Alert  population  to  occurring/  0  0 

upcoming  operations 

Clear/ambush  insurgent  location  3  8 

Collaborate/integrate  intelligence  0  0 

with  other  sources 

Conduct  combined  operations  with  0  0 

host  nation  forces 

Conduct  cordon  and  search. cordon  0  0 

and  knock 

Conduct  reconnaissance  patrol  0  2 

Conduct  security  patrol  1  3 

Conduct  traffic  stops/operate  vehi-  2  2 

cle  checkpoint 

Contain/disperse  civil  disturbances  0  0 

Defend/protect/escort  convoy  0  1 

Disseminate  relevant  or  actionable  0  0 

intelligence 

Disseminate  PSYOPS  products  0  0 

Establish  and  operate  checkpoint/  1  1 

entry  control  points 

Identify  and  disarm  mines/IEDs  0  0 

Identify  and  document  population  0  0 

Apprehend  and  process  captures/  0  1 

detainees 

Obtain  information  from  residents  0  0 

Organize  and  manage  incoming  0  1 

intelligence 

Patrol/defend  utilities  and  infra-  0  0 

structure 

Patrol  forward  operating/firm  base  2  4 

Conduct  raid  1  3 

Reconnoiter  and  survey  routes  0  0 

Provide  security  for  events/groups/  0  0 

personal  security  detachment 

Train  host  nation  forces  0  0 
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a.  Source;  [43]. 

b.  Exposure  is  cumulative  over  rank;  only  required  courses  were  assessed. 
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Unit  commanders  and  trainers  must  make  difficult  judgments  about 
how  to  allocate  the  limited  training  time  that  the  currerit  operational 
tempo  provides  them.  Tools  such  as  these  matrices  help  them  focus 


training  on  those  tasks/skills  Marines  need  but  for  which  they  have 
had  the  least  training.  As  an  aside,  we  were  able  to  take  this  analysis  a 
step  further  by  developing  a  tool  to  help  commanders  estimate  future 
tasking  based  on  the  character  of  their  assigned  area  of  operations 
(AO).‘ 


Takeaway 


As  described  above,  we  have  executed  numerous  studies  focusing  on 
training  assessment  and/or  development  using  the  skills-based 
approach.  In  short,  we  have  applied  this  approach  to  Marine  (A)rps 
training  issues  by: 

•  Assessing  current  or  proposed  training  programs  based  on  crit¬ 
ical  mission  skill  development 

•  Developing  training  parameters/requirements  (based  on  criti¬ 
cal  mission  skill  development)  for  new,  or  non-standard  mis¬ 
sions 

•  Evaluating  how  outside  factors,  such  as  encroachment  and 
resource  constraints,  affect  the  ability  of  the  Marine  Corps  to 
train  critical  mission  skills. 

Regardless  of  the  particular  training  issue,  we  often  use  a  skills-based 
approach  for  deterinining  training  effectiveness,  training  require¬ 
ments,  and  impacts  on  training.  Our  analysts  believe  in  this  approach 
because  it  focuses  on  the  vei^  core  element  of  training —  skill  devel¬ 
opment.  Missions  are  compilations  of  functions,  functions  are  compi¬ 
lations  of  tasks,  and  tasks  are  compilations  of  skills.  Therefore,  if 
Marine  Corps  training  consistently  develops  proficiency  in  the  critical 
skills  that  are  required  to  execute  a  mission.  Marines  have  the  best 
chance  of  successfully  executing  their  missions. 

While  we  have  described  some  of  the  key  applications  of  the  skills- 
based  approach,  these  are  by  no  means  the  only  applications.  They 
simply  demonstrate  how  we  applied  or  recommended  applying  our 
results  to  some  specific  training  questions  we  were  asked  to  analyze. 
Rather  than  being  all-inclusive,  the  list  is  meant  to  show  that  the  skills- 
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based  approach  to  training  assessment  has  a  \vide-ran^e  of  practical 
uses  for  the  Marine  Corps  and  other  SeiTices, 

In  this  section,  we  discussed  one  categoi'y  of  training  analysis  con¬ 
ducted  by  CNA  analysts  over  the  past  20  years.  In  the  next  section,  we 
discuss  an  entirely  different  type  of  analysis  related  to  training —  the 
link  between  training  and  manpower. 


Training  and  manpower 

In  this  section,  we  discuss  the  two  main  series  of  studies  analyzing  the 
linkages  between  training  and  manpower  in  the  Marine  Corps.  The 
first  set  of  studies  focuses  on  attrition,  specifically  attntion  early  in  a 
Marine’s  career.  The  second  set  focuses  on  the  training  pipeline  (i.e., 
how  long  it  takes  to  train  new  Marines,  both  officer  and  enlisted)  and 
how  the  Marine  Corps  might  be  able  to  improve  the  process.  These 
studies  have  primarily  been  executed  by  analysts  in  our  Resources 
Analysis  Division  (or  its  predecessors)  and  target  what  we  call  in  this 
report  the  “economics”  of  training. 

Attrition 


We  executed  a  series  of  studies  in  the  late-198()s  through  the  mid- 
199()s  examining  first-term  attrition  in  the  Marine  ("orps  [46-57]. 
These  studies  analyzed  various  aspects  of  first-term,  or  non-EAS,  attri¬ 
tion  to  determine  trends/levels,  costs,  timing,  links  to  characteris¬ 
tics,^  and  causes. 

For  the  most  part,  we  were  able  to  use  readily  available  data  (within 
the  Marine  0)rps  or  Department  of  Defense)  to  determine  that  while 
overall  attrition  was  steady  from  FT  1980  through  1988,  it  was  on  the 
rise  in  the  early  1990s  despite  improved  accession  cpiality  during  that 
timeframe  [55].  This  was  a  somewhat  surprising  result. 

A  second  key  finding  was  the  link  between  attrition  and  cca  tain 
recruit  characteristics.  We  used  a  shift-share  analysis  to  predict  what 
attrition  rates  should  have  been,  given  the  quality  mix  of  recruits  in 
FT1990  [52].  The  shift-share  technique  divides  the  recruits  into 


7.  (Characteristics  were  based  on  educational  background,  test  scores, 
delayed  entry^  or  immediate  ship,  and  various  accessions  or  waivers. 
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subgroups  (based  on  characteristics)  and  uses  historical  attrition 
rates  for  each  subgroup  to  predict  overall  attrition.  We  found  that 
non-EAS,  first-term  attrition  was  higher  for  recruits  who  [55]: 

•  Did  not  have  regular  high  school  diplomas 

•  Score  lower  on  the  Armed  Forces  qualification  test 

•  Do  not  enter  through  a  Delayed  Entity  Program 

•  Do  not  meet  the  retention  weight-for-height  standard 

•  Require  an  age  waiver 

•  Require  a  medical  waiver 

•  Are  tiying  boot  camp  for  a  second  time  (after  I'ailing  to  com¬ 
plete  it  on  their  first  “try”). 

These  initial  studies  did  not  find  any  systemic  causes  for  early  separa¬ 
tion.  Therefore,  in  the  mid-1990s  we  re-examined  this  issue,  strongly 
focusing  on  physical  attrition  [56,  57].  We  focused  on  physical  attri¬ 
tion  based  on  guidance  from  the  sponsor  and  because  our  initial 
research  indicated  that  a  significant  portion  of  attrition  was  due  to 
physical  reasons.  We  analyzed  attrition  rates  during  bootcamp  as  well 
as  in  the  School  of  Infantiy  (the  follow-on  training  fo^  Marines  with 
an  infan tiy  MOS).  By  analyzing  the  coded  reasons  for  attritions  at 
each  of  these  phases,  and  speaking  to  those  involved  in  the  training, 
we  recommended  the  Marine  Corps  consider  the  following  to  reduce 
non-EAS  physical  attrition  for  first-term  Marines  [57]: 

•  Better  preparation  for  training,  including  a  “remedial”  training 
phase  for  recruits  (particularly  for  those  who  fail  the  Inventoi'y 
Strength  Test),  could  reduce  attrition  by  1-2%. 

•  Sound  physical  training  practices,  including  more  stretching, 
less  training  in  combat  boots,  a  more  gradual  buildup  in  physi¬ 
cal  training,  and  a  focus  on  injury  prevention  in  the  first  3 
weeks  (when  the  vast  majority  of  attrition  occurs).  For  every 
10%  reduction  in  injuries,  we  estimated  that  attrition  would  be 
reduced  by  1%  overall,  5%  for  Marines  at  Marine  Combat 
Training  (MCT),  and  6%  for  Marines  in  the  School  of  Infanti^ 
(SOI). 


•  Additional  resources  and  more  attention  to  injuiy  rehabilita¬ 
tion,  particularly  at  SOI  which  has  a  lower  rate  at  which  Marines 
are  returned  to  training  (from  injuiy)  than  boot  camp. 

Because  the  studies  focusing  on  attrition  for  first-term,  non-EAS 
Marines  were  done  10  to  20  years  ago,  we  advise  the  reader  to  use 
their  results  cautiously  as  the  situation  may  have  changed  consider¬ 
ably  from  that  time.  Rather,  we  include  a  brief  discussion  of  these 
studies  to  highlight  the  types  of  analyses  we  performed  in  examining 
how  attrition  is  related  to  initial  training,  and  how  the  Marine  0>ips 
might  modify  training  programs  to  reduce  it. 


Time-to-train 


The  Marine  (^orps  devotes  a  large  percentage  of  its  budget  to  person¬ 
nel  costs.  Therefore,  any  improvements  in  the  manpower  process  can 
translate  into  significant  savings,  while  at  the  same  time  increasing 
overall  manning  and  readiness.  As  such,  CNA  has  undertaken  several 
studies  to  help  the  Marine  Coips  do  just  that. 

In  2002,  CNA  developed  an  empirical  measure  of  initial  training  by 
primaiT  militaiy  occupational  specialty  (PMOS)  by  constructing  12- 
month  averages  of  the  time  from  the  start  of  active  duty  to  the  assign¬ 
ment  of  the  PMOS  [58].  We  called  this  measure  the  “tiine-to-train’’ 
and  determined  that  actual  training  time  exceeds  planned  training 
time  by  more  than  one-third.  While  this  may,  in  part,  be  due  to  over- 
optimistic  planning  estimates,  it  is  also  veiy  likely  a  result  of  inefficien¬ 
cies  in  the  training  process.  In  addition  to  developing  five  critical 
indicators  for  the  manpower  process,  we  also  attempted  to  determine 
where  inefficiencies  might  exist,  specifically  focusing  on  the  compo¬ 
nents  of  the  total  time-to-train.  For  example,  in  a  (^NA-sponsored 
study,  we  examined  the  “time  spent  waiting  for  training  to  begin”  for 
The  Basic  ("ourse  and  other  local  training  [58,  v59]. 

An  accurate  assessment  of  time-to-train  is  crucial  because  it  results  in 
more  accurate  manning  and  staffing,  and  highlights  those  compo¬ 
nents  of  time-to-train  that  the  Marine  (>)ips  might  want  to  improve. 
As  such,  in  2007-2008,  we  executed  another  study  refining  our  time- 
to-train  measures  by  measuring  three  components  [60,  61  ]: 
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1.  How  much  time  is  spent  in  the  classroom 

2.  How  much  time  is  spent  waiting  for  courses  to  convent 

3.  How  much  time  is  added  due  to  setbacks. 

Ultimately,  we  developed  an  interactive  database  that  the  Marine 
Corps  can  use  to  monitor  the  training  pipeline,  by  the  components 
listed  above  [62].  Table  4  shows  the  type  of  information  that  the  data¬ 
base  can  pro\ide. 


Table  4.  Breakdown  of  time-to-train  days  for  those  with  complete  course  data  and  uninter¬ 
rupted  training:  June  2005  through  May  2007^,  ^ 


Enlisted  Marines 

USMC 

Noninfantry 

Infantry 

officers 

Average  time-to-train  days  for  assigned  PMOS 

225.2 

181.6 

443.4 

Percentage  of  time  in  initial  training  before  PMOS  training 

58.9% 

50.5% 

50.8% 

Percentage  of  time  spent  in  PMOS  courses 

25.8% 

29.1% 

22.7% 

Percentage  of  time  spent  awaiting  training 

13.7% 

13.6% 

19.8% 

Percentage  of  time  spent  in  other  activities^ 

1 .6% 

7.3% 

6.6% 

Number  of  Marines  with  complete  course  data 

20,204 

11,781 

700 

Measures  of  time  spent  awaiting  training  (for  USMC  courses) 

Probability  of  attending  first  available  convening  of  PMOS 

50.3% 

38.0% 

88.8% 

course 

Time-awaiting-training  if  attended  first  available  convening 
(days) 

17.7 

9.8 

34.7 

Time-awaiting-training  if  did  not  attend  first  available  conven- 

43.2 

33.6 

572.9 

ing  (days) 

a.  Source:  162). 

b.  Percentages  may  not  add  up  to  100  due  to  rounding. 

c.  Other  activities  include  time  allowed  for  travel  and  time  between  PMOS  course  graduation  and  ^MOS  attain¬ 
ment. 


As  the  data  in  the  table  show,  Marines  spend  a  large  amount  of  time 
awaiting  training.  In  fact,  it  translates  into  2,666  man-years  awaiting 
training.  They  also  show  that  the  penalty  for  missing  the  first  conven¬ 
ing  course  is  lowest  for  enlisted  infanti'ymen  and  highest  for  officers. 


8.  This  is  based  on  the  information  from  the  32,685  Marines  that  had  com¬ 
plete  data  for  the  two-year  time  period  June  2005  through  May  2007. 
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It  would  be  incorrect,  however,  to  assume  that  the  data  show  ineffi¬ 
ciencies  in  the  training  pipeline.  Given  the  fact  that  there  is  an 
uneven  distribution  of  Marines  entering  the  pipeline  throughout  the 
year  and  that  there  may  be  large  costs  for  increasing  course  capacity 
only  at  certain  times  of  the  year,  the  pipeline  may  be  operating  as  effi¬ 
ciently  as  possible.  The  Marine  Corps  must  make  such  a  determina¬ 
tion  for  itself.  Our  database  is  designed  to  give  the  Marine  Corps  the 
means  to  do  just  that. 
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Conclusion 


A  lethal  and  effective  Marine  is  the  direct  result  of  well-conceived  and 
well-executed  training  programs,  processes,  and  pipelines.  Since  the 
Marine  (Corps’  goal  is  to  produce  such  Marines,  it  spends  a  consider¬ 
able  amount  of  time  and  energy  focused  on  how  it  trains  recruits  as 
well  as  career  Marines.  Over  the  years,  (^NA  has  executed  numerous 
studies  to  help  them  in  this  endeavor. 

We  have  utilized  and  refined  a  methodology,  the  skills-based 
approach,  that  we  believe  is  vei7  effective  in  assessing  or  developing 
Marine  Corps  training.  As  our  analyses  show,  we  have  applied  this 
methodology  in  numerous  ways  to  a  variety  training  questions,  and  a 
range  of  Marine  (a)rps  communities  (e.g.,  aviation,  infantry,  etc.). 
But  by  no  means  are  the  applications  we  discussed  the  only  ones. 
Rather,  we  spend  considerable  time  explaining  the  how  and  why  of 
our  approach  in  order  to  show  the  reader  that  such  a  methodology 
can  be  successfully  applied  to  any  number  of  training  issues. 

We  have  also  done  several  studies  evaluating  the  impacts  on  or  links 
between  training  and  manpower.  Simply  put,  Marines  (i.e.,  man¬ 
power)  are  the  inputs  to  the  training  pipeline.  If  the  training  pij^eline 
is  functioning  well,  it  will  produce  well-trained  Marines  as  quickly, 
effectively,  and  efficiently  as  possible.  Our  studies  examining  the  rates 
of  first-term,  non-EAS  attrition  as  well  as  some  of  its  causes,  along  with 
our  analyses  determining  how  long  it  really  takes  to  train  a  Marine, 
are  designed  to  help  the  Marine  Corps  take  a  critical  look  at  its  pipe¬ 
line  to  determine  if,  and  possibly,  how  it  might  be  improved.  Just  as 
important,  these  analyses  give  the  Marine  Corps  the  tools  to  under¬ 
stand  the  variations  in  time-to-train  over  the  years,  and  to  better  pre¬ 
pare  itself  and  its  commanders  for  the  future. 
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Glossary 


AAA 

anti-aircraft  artilleiy 

AGE 

Air  Combat  Element 

AEW^ 

Ail  bourne  Early  Wai  ninji; 

AO 

area  of  operations 

BUST 

Basic  Urban  Skills  Training 

CAX 

Combined  Arms  Exercise 

CMO 

(avil  Militaiy  Operation 

COIN 

Counterinsurgency 

Cpl 

Corporal 

EAS 

end  of  active  ser\ice 

FP 

Force  Protection 

GCE 

Ground  Combat  Element 

GySgt 

Gunnery  Sergeant 

lED 

impro\ised  explosive  device 

lO 

Information  Operations 

IW 

Irregular  Warfare 

LCpl 

Lance  ("orporal 

LGB 

laser-guided  bomb 

I.L 

Lessons  Learned 

MAGTE 

Marine  Air  Ground  Task  Force 

MCAGCC 

Marine  Corps  Air-Ground  Combat  Outer 

MCT 

Marine  Combat  Training 

MEB 

Marine  ExpeditionaiT  Brigade 

MEF 

Marine  Expeditionaiy  Force 

MCiySgt 

Master  Gunneiy  Sergeant 

MOS 

Militaiy  Occupational  Specialty 

MSgt 

Master  Sergeant 

OIF 

Operation  Iraqi  Freedom 

PMOS 

Primaiy  Militaiy  Occupational  Specialty 

PS\'OPs 

Psychological  Operations 

P\t 

Private 

SA 

situational  awareness 

SAM 

surface  to  air  missile 

SAR 

search  and  rescue 

SAT 

systems  approach  to  training 

Sgt 

Sergeant 

SOI 

School  of  Infan tiy 

SSgt 

Staff  Sergeant 

TEEP 

Training  &  Exercise  Employment  Plan 

T&R 

training  and  readiness 

UTM 

Unit  Training  Management 

wm 

Weapons  Training  Instructor 
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